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Conditions d'optimalite du premier et second ordre pour 
des problemes de commande optimale d'equations integrates 

avec contraintes sur I'etat 

Resume : On s'interesse dans cet article a des problemes de commande optimale d'equations 
integrales, avec contraintes sur I'etat initial-final ainsi que sur I'etat a chaque instant. L'ordre 
d'une contrainte sur I'etat a chaque instant est defini dans le cadre d'une dynamique integrale, 
et on considere ici des contraintes d'ordre quelconque. On obtient des conditions d'optimalite 
necessaires du premier et second ordre, ainsi que des conditions suffisantes du second ordre. 

Mots-cles : commande optimale, equations integrales, contraintes sur I'etat. conditions 
d'optimalite du second ordre 
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1 Introduction 

The dynamics in the optimal control problems we consider in this paper is given by an integral 
equation. Such equations, sometimes called nonlinear Volterra integral equations, belong to 
the family of equations with memory and thus are found in many models. Among the fields of 
application of these equations are population dynamics in biology and growth theory in economy: 
see or its translation in [5T] for one of the first use of integral equations in ecology in 1927 
by Volterra, who contributed earlier to their theoretical study [M]; in 1976, Kamien and Muller 
model the capital replacement problem by an optimal control problem with an integral state 
equation |16| . First-order optimality conditions for such problems were known under the form 
of a maximum principle since Vinokurov's paper |22] in 1967, translated in 1969 |23j and whose 
proof has been questionned by Neustadt and Warga [T^ in 1970. Maximum principles have then 
been provided by Bakke [5], Carlson [3]. or more recently de la Vega [T^] for an optimal terminal 
time control problem. First-order optimality conditions for control problems of the more general 
family of equations with memory are obtained by Carlier and Tahraoui [5]. 

None of the previously cited articles consider what we will call 'running state constraints'. 
That is what Bonnans and de la Vega did in [3], where they provide Pontryagin's principle, 
i.e. first-order optimality conditions. In this work we are particularly interested in second- 
order necessary conditions, in presence of running state constraints. Such constraints drive to 
optimization problems with inequality constraints in the infinite-dimensional space of continuous 
functions. Thus second-order necessary conditions on a so-called critical cone will contain an 
extra term, as it has been discovered in 1988 by Kawasaki [T7] and generalized in 1990 by 
Cominetti |TT], in an abstract setting. It is possible to compute this extra term in the case of 
state constrained optimal control problems; this is what is done by Pales and Zeidan [19] or 
Bonnans and Hermant Ul IHI in the framework of ODEs. 

Our strategy here is different and follows [S] , with the differences that we work with integral 
equations and that we add initial-final state constraints which lead to nonunique Lagrange mul- 
tipliers. The idea was already present in [T7] and is closely related to the concept of extended 
polyhedricity [7|: the extra term mentioned above vanishes if we write second-order necessary 
conditions on a subset of the critical cone, the so-called radial critical cone. This motivates to 
introduce an auxiliary optimization problem, the reduced problem, for which under some assump- 
tions the radial critical cone is dense in the critical cone. Optimality conditions for the reduced 
problem are relevant for the original problem and the extra term now appears as the derivative 
of a new constraint in the reduced problem. We will devote a lot of effort to the proof of the 
density result and we will mention a flaw in [S] concerning this proof. 

The paper is organized as follows. We set the optimal control problem, define Lagrange 
multipliers and work on the notion of order of a running state constraint in our setting in 
section [51 The reduced problem is introduced in section |31 followed by first-order necessary 
conditions and second-order necessary conditions on the radial critical cone. The main results 
are presented in section 21 After some specific assumptions, we state and prove the technical 
lemma [221 which is then used to strengthen the first-order necessary conditions already obtained 
and to get the density result that we need. With this density result, we obtain second-order 
necessary conditions on the critical cone. Second-order suficient conditions are also given in this 
section. Some of the technical aspects are postponed in the appendix. 

Notations We denote by ht the value of a function h at time t if h depends only on t, and 
by hi^t its ith component if h is vector-valued. To avoid confusion we denote partial derivatives 
of a function h of {t, x) by Dth and D^h. We identify the dual space of with the space R"* 
of n-dimensional horizontal vectors. Generally, we denote by X* the dual space of a topological 
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vector space X. We use | • | for both the Euchdean norm on finite-dimensional vector spaces and 
for the cardinal of finite sets, || • ||s and || • \\g,s for the standard norms on the Lesbesgue spaces 
and the Sobolev spaces W''', respectively. 

2 Optimal control of state constrained integral equations 
2.1 Setting 

We consider an optimal control problem with running and initial-final state constraints, of the 
following type: 



(P) min / £{ut,yt)dt + cj){yo,yT) (2.1) 

subject to yf^yQ+ f{t,s,Us,ys)ds, ie[0,T], (2.2) 

Jo 

9{.yt)<0, te[0,T], (2.3) 

$^(yo,yT)=0, (2.4) 

$^(yo,2/T) <0, (2.5) 



where 

U := i°°([0,T];]R™), y := W^'°°{[0,T];R") 

are the control space and the state space, respectively. 

The data are £: x R" ^ M, 0: R" x R" ^ ffi, / : R x M x M™ x R" ^ M", g: M" -> R'', 
$^ : M" X M" R"^ , <I>^ : R" x R" ^ W and T > 0. We set r as the symbol for the first variable 
of /. Observe that if -Dt/ = 0, we recover an optimal control problem of a state constrained 
ODE. We make the following assumption: 

(AO) £, 0, /, g, $^ are of class C°° and / is Lipschitz. 

We call trajectory a pair {u,y) e U x y which satisfies the state equation (|2.2p . Under 
assumption (AO) it can be shown by standard contraction arguments that for any (u, yo) G 
U x R", the state equation (|2.2p has a unique solution y in y, denoted by y[u, yo]. Moreover, the 
map F: W X M" ^ 3^ defined by r(w, yo) := y[u, yo] is of class C°° . 

2.2 Lagrange multipliers 

The dual space of the space of vector- valued continuous functions C ([0,T];R'') is the space of 
finite vector-valued Radon measures ([0, T]; R''*), under the pairing 

■Jlo,T] 1<,<.-^[0,T] 

We define BV ([0, T]; R"*), the space of vector-valued functions of bounded variations, as follows: 
let / be an open set which contains [0,T]; then 

W([0,T];R"*) := {h e L\I:R''*) : L>/i G 7W (/; R"*) , supp(D/i) C [0,T]}, 
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where Dh is the distributional derivative of h; if h is of bounded variations, we denote it by dh. 
For h e BV{[0, T]; M"*), there exists ho_ , /it+ £ K"* such that 

h = ho_ a.e. on (— cxD, 0) n /, , . 

h = hT+ a.e. on (T, +00) n /. ' 

Conversely, we can identify any measure ^ ^ At {[0,T];W*) with the derivative of a function of 
bounded variations, denoted again by fi, such that fiT+ = 0. This motivates the notation d/x for 
any measure in the sequel, setting implicitly = 0. See appendix I A . II for more details. 

Let 

M :=X([0,r];M"), V -.^ BV {[0,T];R"*) . 
We define the Hamiltonian H: [VjxRx M'" x M" ^ M by 

H[p]{t,u,y):^i{u,y)+ptf{t,t,u,y) + PsDrfis,t,u,y)ds (2.7) 
and the end points Lagrangian $ : [K'"*] x R" x M" ^ M by 

*[*](yi,y2) := 0(2/1,2/2) + ^'$(yi,y2) (2.8) 

where s := + s/ and $ ;= ($^, $^). We also denote K := {0}^^ x (R_)'*', so that (|2:4| - ((23| 
can be rewritten as $(2/0, J/t) G K. Given a trajectory (u, y) and (dr/, ^E*) G x M'**, the adjoint 
state p, whenever it exists, is defined as the solution in V of 

-dpt = DyH[p]{t, ut, yt)dt + di]tg'{yt), q^ 
{-Po^,PT+) = D^^]{yo,yT). 

Note that drjtg'{yt) = ^Vi-tg'iiyt)- The adjoint state does not exist in general, but when it 

does it is unique. More precisely, we have: 

Lemma 1. There exists a unique solution in V 0/ the adjoint state equation with final condition 
only (i.e. without initial condition): 

-dpt = DyH[p]{t, Ut, yt)dt + dijtg'iyt), ,^ 
PT+ = Dy,J>[^]{yo,yT)- ^ ■ ' 

Proof. The contraction argument is given in appendix lA.ll □ 

We can now define Lagrange multipliers for optimal control problems in our setting: 
Definition 2. (d?7, ^',p) E A4 x W* x V is a Lagrange multiplier associated with {u,y) if 

p is the adjoint state associated with {u, y, d?/, 5*), (2-11) 



d7/>0, 5(y)<0, / dvtg{yt) = 0, (2.12) 

J[0,T] 

*eiVif ($(yo,yT)), (2.13) 

DuH[p]{t,ut,yt) - for a.a. t G [0,T]. (2.14) 
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2.3 Linearized state equation 

For s e [1, oo], let 

Given a trajectory (m, y) and {v, zq) e x R", we consider the linearized state equation in Zs'. 

zt = zo+ Di^u,y)f{t,s,Us,ys){vs,Zs)ds. (2-15) 

It is easily shown that there exists a unique solution z G Zs of (|2.15p , called the linearized state 
associated with the trajectory {u,y) and the direction (v,zq), and denoted by 2[u,zo] (keeping 
in mind the nominal trajectory). 

Lemma 3. There exists C > and Cs > for any s G [l,oo] (depending on {u,y)) such that, 
for all (w, zo) e Vs X E" and all t € [0, T], 









-/'|.,.|d.) 







(2.16) 

\\z[v,zo]\\i.s<C,{\zo\ + \\v\U). (2.17) 

Proof. (|2.16p is an application of Gronwall's lemma and (|2.17p is a consequence of (|2.16p . □ 

Observe that for s = oo. the linearized state equation arises naturally: let {u,yo) G W x M", 
y := T{u,yo) € y. We consider the linearized state associated with the trajectory {u,y) and a 
direction (w, zq) S W x K". Then 

z[v, Zo] = DT{u, yo){v, zq). (2.18) 
Similarly we can define the second- order linearized state: 

z^[v,zo] :=D^T{u,yo)iv,zof. (2.19) 
Note that z^[w, zg] is the unique solution in y of 

[Oyfit, s, Us, ys)zl + Df^^yy,f{t, s, u„ ys){v,,z[v, zo]sf) ds. (2.20) 
2.4 Running state constraints 

The running state constraints g^, i ~ l,...,r, are considered along trajectories {u,y). They 
produce functions of one variable, 1 1— >■ gi{yt), which belong a priori to VF^'°°([0, T]) and satisfy 



^9i{yt) ^g'tiVt) ( fit,t,ut,yt) 



Drf{t,s,us,ys)ds^ ■ (2.21) 



There are two parts in this derivative: 

i> i I— )■ g[{yt)f{t, t, ut, yt), where u appears pointwisely. 

t> t 1-^ g[{yt) Jq Drfit, s, Us, ys)ds, where u appears in an integral. 

Below we will distinguish these two behaviors and set u as the symbol for the pointwise variable, 
u for the integral variable (similarly for y). If there is no dependance on u, one can differentiate 
again (|2.2ip w.r.t. t. This motivates the definition of a notion of total derivative that always 
"forget" the dependence on u. Let us do that formally. 
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First we need a set which is stable by operations such as in (j2.2ip . so that it will contain the 
derivatives of any order. It is also of interest to know how the functions we consider depend on 
(u, y) eU X y. To answer this double issue, we define the following commutative ring: 



S := < h : h{t,u,y,u,y) 



y2 (^ait, u,y)T\ / ba./iit, s, Us,ys)ds > , (2.22) 
f) -^0 J 



where (t, u, y,u,y) G K x R™ x M" xU x y, the Ua, ha^p are real functions of class C°°, the sum 
and the products are finite and an empty product is equal to 1. The following is straightforward: 

Lemma 4. Let h £ S, (u,y) £ U x y. There exists C > such that, for a. a. t G [0, T] and for 

all (v, 5, V, z) e R™ X M" X X y, 









\<c{\i\~ 




- I\\vs 






Jo 



zs\)dsj. (2.23) 

Next we define the derivation D^^^ : S — S as follows (recall that we set r as the symbol 
for the first variable of f or b): 

1. for /i : {t, u, y) e R X R™ X R" a{t, u, y) € R, 

(^D'-^^h'j (t, u, y, u, y) := Dta(t, u, y) 

+ Dya{t,u,y) (^f{t,t,u,y) + J Drf{t,s,Us,ys)d! 

2. foT h: {t,u,y) eRxU X y ^ b{t, s,u^,ys)ds £ R, 

(^D^^^h^ {t,u,y,u,y) := b{t,t,u,y) + J Drb{t, s,Us,ys)ds. 

3. for any ft-i, /12 G >5, 

It is clear that D^^'^h e S for any h E S. The following formula, which is easily checked on 
h = a(t, u, y) and h = b{t, s, m^, 2/s)ds, will be used for any h G S: 

(^D'-^^h'j {t, ut, yt,u, y) = Dth{t, ut,yt, u, y) + Dyh{t, ut,yt, u, y)f(t, t, ut, yt) 

+ Dyh{t,ut,yt,u,y) [ Drfit,s,Us,ys)ds. (2.24) 
Jo 

Let us now highlight two important properties of D^^\ First, it is a notion of total derivative: 
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Lemma 5. Let h E S be such that D^h = 0, {u,y) E U x y be a trajectory and 

ip: ti-^ h{t,ut,yt,u,y). 

Then If e W^'°°{[0,T]) and 



(2.25) 
(2.26) 

(2.27) 
(2.28) 



Proof. We write h as in (P?^ . If Duh = 0, then for any uq e M™, 
if(t) = h{t,uo,yt,u,y) 

= ^<^a{t,uo,yt)Y\_ / ba,fi{t,s,Us,ys)ds. 

By f!Tm . ifi G iyi'°°([0,r]). And by (I^TTTI) . 

^(t) = Dth{t,uo,yt,u,y) + Dyh{t,uo,yt:U,y)yt 
= Dth{t, ut,yt, u, y) + Dyh{t, ut,yt, u, y)yt 
since D^Dth = DtDuh = and DuDyh = 0. Using the expression of yt and (|2.24p . we recognize 

doa . □ 

Second, it satisfies a principle of commutation with the linearization: 

Lemma 6. Let h, (u, y) be as in lemma\^ (u, zq) G V, x M", z zg] G 2, for some s G [1, oo] 
and 

ip-.t^^ D(^y^u,y)Ht^'^^t,yt,u,y){zt,v, z). (2.29) 

Then ^ G W^''{{^,T\) and 



^(i) = ^{u,yM,y) (^D^^^h^ (t, tit, yt, y) ivt,Zt, V, z). 
Proof. Using DuD(^y^^ y^h = 0, we have 

ip{t) = D(y^^^y)h{t, Uq, yt,u, y){zt, v, z) 
= ^^^y°'a{t,UQ,yt)ztW^ j ha^pAs 

+ ^aa{t,UQ,yt) j D(^^^y^ba,i3{t,S,Us,ys){Vs,Zs)ds Y[ / &a,/3'ds. 



(2.30) 



It implies that -0 & W^^''*([0, T]) and that 

= Dl^y,u.y)Ht^ut,yt,u,y){zt,v,z) 

+ Dl,(y.u,y)Ht, uu yt, u, y) {yt, {zt,v, z)) + Dyh{t, ut, yt,u, y)zt. 

On the other hand, we differentiate D^^^^h w.r.t. {u,y,u,y) using (|2.24p . Then with the expres- 
sions of yt and zt, we get the relation (|2.30p . □ 
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Finally we define the order of a running state constraint g^. We denote gj-''^^'' := ZJ^^^gp' 
(with gl^-* := gi). Note that gi S 5, so g^'' € S for all j > 0. Moreover, if we write g^'''^ as 
in (|2.22p . the Oq and ba.p are combinations of derivatives of / and gi. 

Definition 7. The order of the constraint gi is the greatest positive integer qi such that 

=0 foraUj=0,...,(Z, -1. 

We have a result similar to Lemma 9 in [4J, but now for integral dynamics. Let {u,y) E U x y 
be a trajectory, {v, zq) G Vs x R", and z := z[v, zq] G for some s G [1, cx)]. 

Lemma 8. Le< 6e of order at least qi G N* . Then 

t^giivt) gM^«-°°([0,T]), 

a?^c^ 

=5F^(i,?/t,w,2/), J = l,...,ft-1, (2.31) 

-^^g^{y)\t=9^\i.y^uyuu,y), (2.32) 
d^ - ( ■) 

■^9l{y)z\t = DgY'{t,yt,u,y){zt,v,z), j = 1, . . . , - 1, (2.33) 

^5Ky)^k = Dug\'"-\t,ut,yt,u,y)vt + bg\'^'\t,ut,yt,u,y){zt,v, z), (2.34) 
where we denote by D the differentiation w.r.t. (y,u,y). 

Proof. It is straightforward with lemmas [S] and [BJ definition [7] and an induction on j. □ 

3 Weak results 

3.1 A first abstract formulation 

The optimal control problem (P) can be rewritten as an abstract optimization problem on (u, yo). 
The most naive way to do that is the following equivalent formulation: 

(P) min J{u,yo) (3.1) 

subject to 9{y{u,yo]) e C_ ([0,T];M'-) , (3.2) 

Hyo,y[u,yo]T) e K, (3.3) 

where ^ 

•/(■", 2/o) := / iiut,y[u,yo]t)dt + (j){yo,y[u,yo]T) (3.4) 

and <I> = , ^^), K = {0}^^ x (]R_)''^ . In order to write optimality conditions for this problem, 
we first compute its Lagrangian 

L(u,?/o,d77, «») := J(u,yo) + / d77tg(y[M, yo]t) + ^'^'(yo, 2/[u, 2/o]t) (3.5) 

J[0,T] 
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where {u, yo, di], 5') G W x R" x x W* (see the begmnmg of section 1^?^ . A Lagrange multiplier 
at {u, yo) in this setting is any (dry, VP) such that 

i?(„,^„)L(u,2/o,d?7,*) =0, (3.6) 
(dr?,*) eiVc._([o,T];K-)xx(5(y),*(2/o,yr)). (3.7) 

This definition has to be compared to definition [2J 

Lemma 9. We have that (drj, 4*) is a Lagrange multiplier of the abstract problem (|3.ip - (j3.3p at 
{u,yo) iff (dry, 4',p) is a Lagrange multiplier of the optimal control problem (|2.ip - (|2.5p associated 
with {u,y[u,yo]), where p is the unique solution of (j2.10p . 

Proof. Using the Hamiltonian (j2.7p . the end points Lagrangian (j2.8p and the formula (jA.lOp of 
integration by parts for functions of bounded variations (see appendix lA.ip . we get 

L(u,?/o,d77, 5') = / H[p]{t,ut,yt)dt + {dptyt + dr]tg{yt)) 
Jo Jlo.T] 

+ Po-yo -PT+yr + $[^'](2/o,yT) 

for any p G V and y = y[u,yo]- We fix {u,yo,dri,^), we differentiate L w.r.t. {u,yo) at this 
point, and we choose p as the unique solution of (|2.10p . Then 

D(u,yo)L{u,yo,dr],'^){v,zo) = / DuH[p]{t,ut,yt)vtdt 

Jo 

+ (po_ +Dy,<i>['i>]{yo,yT)) zq 

for all (w, zo) e X M". It follows that is equivalent to and (^1^ . And it is obvious 

that (PT7| is equivalent to (PT^ - ipi^ . □ 

Second we need a qualification condition. 

Definition 10. We say that (u, y) is qualified if 

(w,zo) ^ i:'$^(yo,yT)(zo,^[w,zo]T) ■ 
WxR" ^ M'*^ IS onto, 

(ii) there exists (v, zq) G x IR" such that, with z — z[v,zo], 
D^^{yo,yT){zo,ZT)=Q, 

D^i{yo,yT){zo,ZT) <0, i e {i : $.f (yo, yr) = 0} , 

9[{yt)zt < on {t : g,{yt) = 0} , i = l,...,r. 

Remark 11. 1. This condition is equivalent to Robinson's constraint qualification (intro- 
duced in [20], Definition 2) for the abstract problem p.ip - p.3p at (u, yo); see the discussion 
that follows Definition 3.4 and Definition 3.5 in |T7] for a proof of the equivalence. 

2. It is sometimes possible to give optimality conditions without qualification condition by 
considering an auxiliary optimization problem (see e.g. the proof of Theorem 3.50 in [7]). 
Nevertheless, observe that if (u, y) is feasible but not qualified because (i) does not hold, 
then there exists a singular Langrange multiplier of the form (0, <I>^, 0). One can see that 
second-order necessary conditions become pointless since —(0, 0) is a singular Lagrange 
multiplier too. 
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Finally we derive the following first-order necessary optimality conditions: 

Theorem 12. Let {u,y) be a qualified local solution of (P). Then the set of associated Lagrange 
multipliers is nonempty, convex, bounded and weakly * compact. 

Proof. Since the abstract problem p.ip - (j3.3p is qualified, we get the result for the set {(dry, 5*)} 
of Lagrange multipliers in this setting (Theorem 4.1 in [SB]). We conclude with lemma IHl and the 
fact that 

7W X — > MxR"* xP 
(dry, *) I — > (d?/, 

is afhne continuous (it is obvious from the proof of lemma [T]). □ 

We will prove a stronger result in section [?J relying on another abstract formulation, the 
so-called reduced problem. The main motivation for the reduced problem, as mentioned in the 
introduction, is actually to satisfy an extended polyhedricity condition (see Definition 3.52 in [7]), 
in order to easily get second-order necessary conditions (see Remark 3.47 in the same reference). 

3.2 The reduced problem 

In the sequel we fix a feasible trajectory {u,y), i.e. which satisfies (|2.2p - (j2.5p . and denote by A 
the set of associated Lagrange multipliers (definition [2|) . We need some definitions: 

Definition 13. An arc is a maximal interval, relatively open in [0,r], denoted by (ti,T2), such 
that the set of active running state constraints at time t is constant for all t G (ti, T2). It includes 
intervals of the form [0,t) or (t, T]. If t does not belong to any arc, we say that r is a junction 
time. 

Consider an arc (ti,T2). It is a boundary arc for the constraint gt if the latter is active on 
(ti,T2); otherwise it is an interior arc for g^. 

Consider an interior arc {ti,T2) for gi. If gi{T2) ~ 0, then T2 is an entry point for gi\ if 
9i{Ti) = 0, then ri is an exit point for g^. If r is an entry point and an exit point, then it is a 
touch point for gi. 

Consider a touch point r for gi. We say that r is reducible if -^giiyt), defined in a weak 
sense, is a function for t close to t, continuous at r. and 

d2 

-^9i{yt)\t=r < 0. 

Remark 14. Let r be a touch point for gi. By lemma [51 if gi is of order at least 2, then r is 
reducible if t n- {t,ut,yt,u,y) is continuous at t and {T,Ur,yT,u,y) < 0. Note that the 
continuity holds either if u is continuous at r or if gi is of order at least 3. 

The interest of reducibility will appear with the next lemma. For r G [0, T] and e > (to be 
fixed), we define : W^^°°{[0, T]) -J^ M by 

^ir (x) := max {xt : t e [t - e,T + e]n[0,T]} . (3.8) 

Lemma 15. Let gi not be of order 1 (i.e. D^g^j^^ = Oj and t be a reducible touch point for gi. 
Then for e > small enough, is in a neighbourhood of gi{y) G iy^'°°([0, T]) and twice 
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Frechet differ entiable at giiy), with first and second derivatives at gi{y) given by 

D^J.T{gi{y))x = Xr, (3.9) 
D'^lr{g^{m^r = -4? ^, (3.10) 



dt 



for any x G W'^'°°{[0,T] 



Proof. We apply Lemma 23 of |4] to gi{y), which belongs to W^'°°([0, T]) by lemma|8]and satisfies 
the required hypotheses at r by definition of a reducible touch point. □ 

Remark 16. We can write p.9p and (|3.10|1 for x — g'j^{y)z[v, zq] (since gi is not of order 1). By 
lemma m (|3.10p becomes 

(Dg'i^\T,yr,u,y){zr,v,z)) 

D't^rig^mig-iy^r = ^y- (3.ii) 

9i [T,Ur,yT,u,y) 

where z = z[v, zq], {v, zq) eU x R" and D is the differentiation w.r.t. {y, u, y). We will also use 
(|3.9p for X ~ g'/{y){z[v,zo])'^ + g'^{y)z'^[v, zq], z'^[v,zo] being defined by (|2.19p . It can indeed be 
shown that it belongs to W^'°"{[0,T]). 

In view of these results we distinguish running state constraints of order 1. Without loss of 
generality, we suppose that 



l> gi is of order 1 for i = 1, . . . , ri , 
[> gi is not of order 1 for i = ri + 1, 
where < J'l < r. We make now the following assumption: 

(Al) There are finitely many junction times, and for i = ri + 1, . . . , r all touch points for gi are 
reducible. 

For i = 1, . . . , ri we consider the contact sets of the constraints 

X, :={te[0,T] : 5,(^^ = 0}. (3.12) 

For i = ?'i + 1, . . . , r we remove the touch points from the contact sets: 

7i := the set of (reducible) touch points for gi, (3.13) 
I,:^{te[0,T] : g,{yt)=0}\%. (3.14) 

For I = 1 , . . . , r and £ > we denote 

If := {t e [0,T] : dist(t,T,) < e}. (3.15) 

Assumption (Al) implies that If has finitely many connected components for any e > (1 < 
i < r) and that % is finite (1 < i < ri). Let N := X]ri<j<r l"^!- 
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Now we fix £ > small enough (so that lemma [13] holds) and we define 

r 

GiKyo) (5^(2/[",2/o])kOi<,<,, K\ ■.= l[C- (It) , (3.16) 



i=l 



G2iu,yo)■.^{^^ri9^iy[u,yo]))),^r.^^,<^<r^ ^2 := , (3.17) 

G3(w,yo) := $(yo,2/[w,2/o]T), A'3 A'. (3.18) 

Recall that J has been defined by (|3.4p . 



The reduced problem is the following abstract optimization problem: 

Gi(w,yo) e i^i 

(Pr) mm ^ J(w, yo), subject to ■( G2{u,yo) € K2 



(«,yo)6WxI 



Remark 17. We had fixed {u,y) as a feasible trajectory; then (u,yo) is feasible for (Pr). 
Moreover, {u, y) is a local solution of (P) ijff (it, yg) is a local solution of (Pr), and the qualification 
condition at {u,y) (definition llOp is equivalent to Robinson's constraints qualification for (Pr) 
at {u,yo) (using lemma [T5l) . 



Thus it is of interest for us to write optimality conditions for (Pr). 

3.3 Optimality conditions for the reduced problem 

The Lagrangian of (Pr) is 



Pi?(",2/o,dp,zy,^') := J(M,yo) + Y] / 9riy[u,ya]t)dpi.t 

^ '^t,TtJ'T{gi{.y[u,yo])) + 'i<^{yo,y[u,yo]T) (3.19) 



l<i<r ' 



reTi 
ri <i<r 



where ueU, yo e M", dp e ]^ X (Zf ) , v e M^*, * £ 



z=l 



As before, a measure on a closed interval is denoted by dfi and is identified with the derivative 
of a function of bounded variations which is null on the right of the interval. 
A Lagrange multiplier of (Pr) at (u, yo) is any (dp, v, 5*) such that 

D{u,yo)LR{u, yo, dp, V, *) = 0, (3.20) 
dp^>0, 9^iy)\x| <0, [ g,(y*)dpM=0, i = l,...,r, (3.21) 
Vt^T > 0, Pr {9i{y)) < 0, lyi^rPr (3t(j/)) =0, T G 7^, i = j'l + 1, . . . , r, (3.22) 

eNKmyo,yT))- (3.23) 

We denote by Ar the set of Lagrange multipliers of (Pr) at (u,yo)- The first-order necessary 
conditions for (Pr) are the same as in theorem [T^ 

Lemma 18. Let (u, yo) o, qualified local solution of (Pr)- Then Ar is nonempty, convex, 
bounded and weakly * compact. 
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Given (dp, i^) G OLi M {If) x R^*, we define d'q e M hy 

d,,:=(^' , ^-l,---,-, (3.24) 

i l^T&Ti^i^'^"'^ elsewhere, i = r'l + 1, . . . , r. ^ ' 

Conversely, given drj e M, we define (dp, v) e Yll=i i^i) ^ by 

dpi := d?7j|i.= z = 1, . . . ,r, 
i^i^r ■= dijidr}) reTi, i = ri + l,...,r. 

In the sequel we use these definitions to identify (dp, and drj, and we denote 

[rj,,r]:^drj,{{T}). (3.26) 

Recall that A is the set of Lagrange multipliers associated with {u,y) (definition . We have a 
result similar to lemma [51 

Lemma 19. We have that (dp, ly, 'I') G A/j iff (d?/, "^jp) G A, withp the unique solution of (|2.10p . 

Proof. With the identification between (dp, i^) and dzy given by p.24p and p.25p . it is clear that 
p.2ip - (|3.22p are equivalent to (|2.12p . Let these relations be satisfied by (dp, i^, 4*) and (dyy, 'I'). 
Then in particular 

supp(d77j) = supp(dpi) Cli i=l,...,ri, (3 27) 

supp(d77i) = supp(dpi) U supp(X] i^j,r<^T) Cli U 7j i = ri + 1, . . . ,r. 

We claim that in this case p.20p is equivalent to (|2.1ip and (|2.14p . Indeed, using H[p] defined 
by (P?7)) . $[^'] by the integration by parts formula (jA.lOp and (|X?f|) . we have 

Lfl(u, 2/o,dp, i^, = / {H[p]{t,ut,yt)dt + dptyt)+Po-yo~PT+yT 
Jlo.T] 

+ J2 [ 9^{yt)dv^,t+ h.r]^^r{9^{y)) + ^'i']{yo,yT) (3.28) 

ri <i<r 

for any p € V and ?/ = yo]- Let us differentiate (say for i > ri) 

/ 9tiyt)<im,t + y^h.AiJ.T {gi{y)) (3.29) 

w.r.t. (u,j/o) (u, j/o) in the direction (1^,2:0) and use p.9p and p.27p : we get 

/ gl{yt)ztdvt,t+y2h,T]DiJ-T{gi{y)){9',{y)z) = g[{yt)ztdn,^t 

where z = z[v, zq]. Let us now differentiate similarly the whole expression p.28p of L^; we get 

/ DuH[p]{t,ut,yt)vtdt+ j [DyH[p\(t,ut,yt)dt + dpt + dr]tg'{yt))zt 
Jo J[0;T] 

+ (po- + Dy,^^]{yo,yT))zo + {- PT+ + Dy,^myo,yT))zT. (3.30) 

Fixing p as the unique solution of (j2.10p in p.30p gives 

D{u,va}LRiu,yo,dp,iy,-^){v,zo) = / D.uH[p]{t,ut,yt)vtdt 

Jo 

+ (po_ +Dy,<i>[-f]{yo,yT))zo. 
It is now clear that (P?^ is equivalent to (PTTTj) and ^J^. □ 
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For the second-order optimality conditions, we need to evaluate the Hessian of Lfj. For A 
(d?7, "i!,p) e A, {v, zq) X M" and z = z[v, zq] G y, we denote 



T 

2 



E [''^-] + ^Vr • (3.31) 



In view of p. lip and p.27p . we could also write 

J[A](«,zo) = / Df^y^,H[p]{t,ut,yt){vt,zt)^dt + D^^^]{yn,yT){zn,ZTy 



r , „ (Dgl^\T,yr,u,y){zr,v,z) j 

+ dW(2/t)(^*)' - E [^»^-]^ — M-. r^- (3.32) 

■^lo^T] ^g^^ 5> '{T,Ur,yr,U,y) 

ri <i<r 

Lemma 20. Let (dp, j/, '5) S Ajj. iet A = (d?7, & K be as in lemma [7^ T/ien /or al/ 

(w,zo) e X M", 

^(«,yo)^-^«("'yo,dp,i^,*)(z;,zo)' = J[A](«,zo)- (3.33) 

Proof. We will use p.28p and (|3.29p from the previous proof. First we differentiate p.29p twice 
w.r.t. (u,yo) at (u, j/o) in the direction (w,zo). Denoting z = z[w,zo] and = z^[i;,zo], defined 
by (prg)) . we get 

9i{yt){ztf + 9i{yt)zt) diji^t 

+ E [^^-] [^'^- (ff^(y)) (5Ky)^)' + Di^r {g^{y)) {g'liyWf + g'Mz')] 

= / 9'l{yt){ztf<^m,t + / g'iiyt)zfdr]i^t 

Jli "'[0,T] 

+ E [^-l t^''^- {9mz?+9'l{yr){Zrf] , 

where we have used remark[Tni p.9p and p.27p . Second we differentiate L u twice using p.28p and 
then we fix p as the unique solution of (|2.10p . The result follows as in the proof of lemma [121 D 

Suppose that A 7^ and let A = (d^, ^,p) G A. We define the critical cone as the set C2 
of (w, zq) G V2 X M" such that 

g'Mz<0 onI„ 

5^^)^ = on supp (d77,) n I., * - ■ • ■ > ^> l^-i4J 

fl^^;^^;_-°' „ re?;, * = ri + l,...,r, (3.35) 

^*(yo,yT)(2:o,^T) e Tk {^{yo,yT)) , (.3 3g<, 

^D^{yo,yT){zo,ZT) = 0, ^ ' 
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where z = z[v,zo] G Z2. Then the critical cone for (Pr) (see Propositfon 3.10 in 0) is the set 

Coo C2 n X K" ) , 

and the cone of radial critical directions for (Pr) (see Definition 3.52 in [7]) is the set 

:= {iv,zo) e Coo : 3a > : g,{y) + dg[{y)z < on If, i^l,...,r}, 

where z = z[v, zq] £ 3^. These three cones do not depend on the choice of A. In view of lemma 
the second-order necessary conditions for (Pr) can be written as follows: 

Lemma 21. Let (u, j/o) be a qualified local solution of (Pr). Then for any {v,zo) € C^, there 
exists A G A such that 

J[A](t;,zo) > 0. (3.37) 
Proof Corollary 5.1 in [T7]. □ 

4 Strong results 

Recall that {u, y) is a feasible trajectory that has been fixed to define the reduced problem at 
the beginning of section [ 



4.1 Extra assumptions and consequences 

We were so far under the assumptions (AO)-(Al). We make now some extra assumptions, which 
will imply a partial qualification of the running state constraints, as well as the density of 
in a larger critical cone. 



(A2) Each running state constraint 5^, i = 1, . . . , r is of finite order qi. 

Notations Given a subset J C {1, . . . ,r}, say J = {ii < ■ ■ ■ < i;}, we define G 
W xUxy ^ Rl-'l by 



(<?). 



G^j\t,u,y,u,y) 



( 9n^'\t,u,y,u,y)\ 



\9u'^'\t,u,y,u,y)J 



(4.1) 



For eo > and i G [0,r], let 

It" ■.= {l<i<r : t Glf }, (4.2) 

:= Di,G[ll {t, ut, yt,u, y) G R'^*'" ' x R™*. (4.3) 

(A3) There exists eo,7 > such that, for aU t G [0,r], 

\{Mrf^\>^\£,\ VCgRI^'^I. (4.4) 

(A4) The initial condition satisfies g{yo) < and the final time T is not an entry point (i.e. 
there exists t < T such that the set /° of active constraints at time t is constant for 

te{T,T]). 
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Remark 22. 1. We do not assume that u is continuous, as was done in [S]. 

2. Recall that e has been fixed to define the reduced problem. Without loss of generality 
we suppose that eo > e, eo < min{r : r junction times} and 2eo < min{|r — r'| : 
T, r' distinct junction times}. We omit it in the notation M^" . 

3. In some cases, we can treat the case where T is an entry point, say for the constraint gf. 

> if 1 < i < ri (i.e. if qi = 1), then what follows works similarly. 

> if ri < z < r (i.e. if qi > 1) and ■^gi{yt)\t=T > 0, then we can replace in the reduced 
problem giiy[u,yo])\[T-e.T] < by the final constraint 5i(2/[w, 2/o]t) < 0. 

4. By (Al), we can write 

[0,T] = JoU---U J„ (4.5) 

where J; (/ = 0, . . . , k) are the maximal intervals in [0, T] such that 1^" is constant (say equal 
to J;) for t E Ji. We order Jq, . . . , Jk in [0, T]. Observe that for any I > 1, J;_in J; = {rieo} 
with T a junction time. 

For s G [1, (X)], we denote 

r r 

W^(«)'"([0,r]) :=[]W^9-"([0,T]), W(9)^^(I") :=[]VF9-"(Tf), (4.6) 



j=i i=i 



and for ip 



G W^(«)''*([0,T]), ip 



I' 



G w^('')^"(z^). 



Using lemma [S] we define, for s G [1, oo] and zq G M", 

g'{y)z[v,zo\. (4.7) 

We give now the statement of a lemma in two parts, which will be of great interest for us 
(particularly in section B.3.3p . The proof is technical and can be skipped at a first reading. It is 
given in the next section. 

Lemma 23. a) Let s G [l,oo] and zq G K". Let b G W^^'?^'''(I'^). Then there exists v e Vs such 
that 

{As,z,v) li. = b. (4.8) 
b) Let zo G R". Let (b,v) G W^(«)'2(I-) x V2 be such that 

iA2,.„v) lie = b. (4.9) 

Let b^ G W^(«)'°°(J^), ken, be such that 6'= b. Then there exists v'' eU, k eN, 

such that — > v and 

{Aoo.zov'') lie - 6^ (4.10) 
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4.2 A technical proof 

In this section we prove lemma [221 The proofs of a) and b) are very similar; in both cases we 
proceed in k + 1 steps using the decomposition (|4.5p of [0,T]. At each step, we will use the 
following two lemmas, proved in appendixes IA.3l and lA.21 respectively. 
The first one uses only (Al) and the definitions that follow. 

Lemma 24. Let to := t ± Eq where t is a junction time. 

a) Let s e [l,oo] and zq G R". Let (b,v) £ W^i^'^^I^) x be such that 

{As^zov)\x. =b on[0,to]. (4.11) 
Then we can extend b tobe W^(«'^"([0, T]) in such a way that 

b = As,z„v on[0,to]. (4.12) 

b) Let zo e M". Let (b,v) £ W^(«)'2(I^) x V2 be such that 

iA2,.„v) = b. (4.13) 

Let {b'',v'') e M/(9)'°°(Z^) xU, keN, be such that {b^,v^) '^'"''^ '''^'> (6, w) and 

{Aoo,.y) =b'' on [0,to]. (4.14) 

Then we can extendb^ to b^ G Vl/(«)'°°([0, T]), fc g N, m such a way thatb'' A2,z„v 
and 

b'' =Aoo^,„v'' on[QM- (4.15) 

The second lemma relies on (A3). 

Lemma 25. Let s G [1, 00] and zq G M". Let I be such that Li ^ 0. For t G J;, we denote (recall 
that D is the differentiation w.r.t. {y,u,y)) 



\ Mt ■.^DuG'jf{t,ut,yt,u,y)em.\'^^ x R-*, 

\ Nt -.^ DG\f{t,ut,yuu,y) eR\''\ x R"* xW xy*. 

a) Let (h,v) G L'*( J;; R'"'^'') x Vs- Then there exists v £Vs such that 
V ~ V on Jq\J ■ ■ ■ \J J(_i, 

MtVt + Nt {z[v, zo]*, w, z[v, zq\) = ht for a.a. t G J;. 



(4.16) 



(4.17) 



b) Let {h,v) G L''(J,; RI^'I) x Vs be such that 

MfVt + Nt {z[v, zo]t,v, z[v, zo]) = ht for a.a. t G Ji. (4-18) 



Let {h^,v^) G L°°(J/;Rl^'l) xU,k^n,be such that {h^,v'') > {h,v). Then there exists 

v'^ EU, keN, such that — > v and 



ii'' ^v''- on JoU---LlJi-i, , . 

Mti^ + Nt (z[^}^ zo]t, «^ z[i\zo]) = h'^ for a.a. t € Ji. ^ ' 
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Proof of lemma [23i In the sequel we omit zq in the notations, 
a) Let b € W'^'>'> We need to find v eVs such that 

9'iiy)4v] = h on II, i = 1, . . . , r. 

Since 

V ^v' on [0, t] =^ = z[v'] on [0, t], 
let us construct . . . , w** G Vs such that, for all I, 

= v^-'^ on_Jo U • • • U Ji-i, 
g-{y)z[v^] = &i on If n Ji, i = 1, . . . ,r 



(4.20) 



and V := v"^ will satisfy (|4.20p . 

By (A4), Jo ~ [0, Ti — £o) where ti is the first junction time and If n Jq = for all i. Then 
we can choose := 0. 

Suppose we have for some / > 1 and let us construct vK Applying lemma [Ml a) 

to (6, v'-i) with {to} = JTi n Ti, we get 6 e M^(9'-^([0, T]). Since Zf n J; = if i ^ it is now 
enough to find such that 



= w'-i on Jo U • ■ • U J;_i, 
5Ky)^b'] = b, on J;, i e 



(4.21) 



Suppose that v = v on Jq U • ■ • U Jj-i. Then g-{y)z[v'] = bi on Ji_i, and it follows that 



9'ii.y)zW] = bi on Ji 

t 

- — qUy)z\v ] = - — bi on J;. 



(4.22) 
(4.23) 



And by lemma |S1 (|4.23p is equivalent to 

D^g^^^^ {t, uuvu u, y)v\ + Dg^^^\t, Ut,yt,u, y)(^b']t, v\z[v']) = b^'\t) (4.24) 
for a. a. t G Ji. 

If // = 0, we choose := w'^^. Otherwise, say /; = {ii < • ■ • < ip} and define on J; 



eL-^(Ji;Ml^'l) 



Then (j4.2ip is equivalent to 



v'^ = v'-i on Jo U • • • U J;_i, _ 
MtuJ +iVt(z[w']t,u',z[u']) = /li for a.a. t e J;. 

Applying lemma [?51 a) to (/i, u'"-'^), we get v such that (j4.25p holds; we choose f' u. 

b) We follow a similar scheme to the one of the proof of a). 



(4.25) 
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Let {b,v) e X V2 be such that 

g'tiyJ^M = on I", i = l,...,r. 



Let b'' e /fc e N, be such that b 

> V and 



k 1^'"''^ I T ^ ^ ^ fcO 

> 0. Let us construct v ' , 



fc e N, such that for ah I, w*^'' ^ 



^ ^fe,i-l on Jo U • ■ • U J;_i, 

= fe.*^ on If n J/, i e 

We wiU conclude the proof by defining v'^ w'^'-", fc 6 N. 

We choose for u*^'" the truncatfon of u, fc G N (see definition HTI in appendix IA.2p . 

Suppose we have w'^'", . . . , u*^''"^, fc g N, for some Z > 1 and let us construct v'''\ fc G N. 
Applying lemmaUlb) to (6'^', w*^''"!) with {^o} = l^r\Ti, we get G Vr(«)'°°([0, T]), fc G N. 
In particular, 



5^= 



> b 



(4.26) 



where b ,g'(y)z[u] G ^/^(''^'^([O, T]). And it is now enough to find v'''\ fc G N, such that 



v^'^ ~ — > V and 



^k,i ^ ^,k.i-i on Jo U • ■ • U J;_i, 
.9^(y)z[t;'=''] = 6*^ on J,, i G 



(4.27) 



If /; — 0, we choose v ' = v ' ^, /e G M. Otherwise, say /; = {zi < • • • < ip} and define on Jj 



G L^(Ji;Rl^'l), /i'^' I : I G L°°(Ji; RI^'I) 



We have 



MjWt + Nt{z[v]t, V, z[v]) ^ ht for a.a t G J; 



and (|4.27p is equivalent to 



yk,i ^ ^k,i~i on Jo U • • ■ U J(_i, 

MtVt'' + Nt(z[v''^%,v'''^,z[v'''^]) = h'i for a.a. t G Jj. 



(4.28) 



By (|4.26p . — > h, and by assumption, v'^'''~^ > v. Applying lemma b) to [h^ ,v^'^~^), 



L 

we get ^ fc G N, such that — > v and (|4.28p holds; we choose w'""'' = v^, fc G N. 



□ 



4.3 Necessary conditions 

Recall that we are under the assumptions (A0)-(A4). 
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4.3.1 Structure of the set of Lagrange multipliers 

Recall that we denote by A the set of Lagrange multipliers associated with {u, y) (definition [2]). 
We consider the projection map 

TT : MxW* xV — > M^* X W* 

where r e 7^, i = ri + 1, . . . , r. A consequence of lemma a) is the following: 
Lemma 26. ttIa is injective. 

Proof. We will use the fact that one of the constraint, namely Gi, has a surjective derivative. 
For dp e nl=i X (^f)> we define Fp e by 

Fp{^):= I f^.fiP'^.t forall^eTy(«)'°°(X^). 

l<i<r''^i 

Since by lemma[Hl DGi{u, yo)(w, ^o) G VK(«)'°°(T=) for all (u, zo) eU x R", we have 
(dp,DG'i(u,yo)(w,zo)) = (Fp, DGi{u,yo){v, zq)) 

= {{DGi{u,yo))* Fp,{v,zo)). 
Then differentiating Lj^, defined by (|3.19p . w.r.t. (u,?/o) we get 

D(u,yo)LR{u,yo,dp, ly,'^) 

= DJ{u, yo) + DGi{u, y^fFp + DG2{u, y^fv + DG:i{u, yo)**- (4.29) 

Let (d7?, (d7?', G A and suppose that t: {{drj.^! ,p)) = tt ((d?/, ^/'jp')). By lemma [191 

let (dp, z^), (dp', I/') be such that {dp,v,^),{dp' ,v' ,^') G A^j. Then (i/, *) = {v',^'), and by 
definition of Aij, 

I^(u,yo)LR{u, yo, dp, V, = D(.^^y^)LR{u, yo, dp', v, = 0. 

Then by (j4.29p . DGi{u,yo)*Fp — DGi{u,yo)* Fp' . And it is a consequence of lemma [231 a) that 
DGi{u,yoY is injective on (M/^(«)'°°(I-))*. Then i^p = Fp, , and by density of W^(«)'°°(X^) in 
J|C(Zf), we get dp = dp'. Together with v = v' , it implies dr] = d?7' and then (dry, = 
(dr/',^'',p'). □ 

As a corollary, we get a refinement of theorem [T^ 

Theorem 27. Lef (u,j/) 6e a qualified local solution of (P). Then A is nonempty, convex, of 
finite dimension and compact. 

Proof. Let A^r := 7r(A). By theorem 1121 A is nonempty, convex, weakly * compact and Ajr is 
nonempty, convex, of finite dimension and compact (tt is linear continuous and its values lie in 
a finite-dimensional vector space). By lemma [551 ttIa : A — > A^r is a bijection. We claim that its 
inverse 

m : Att — A 

is the restriction of a continuous affine map. Since A — m (A^r), the result follows. For the claim, 
using the convexity of both A^ and A, the linearity of tt and its injectivity when restricted to A, 
we get that m preserves convex combinations of elements from A^. Thus we can extend it to an 
affine map on the affine subspace of M^* x W* spanned by A^r. Since this subspace is of finite 
dimension, the extension of m is continuous. □ 
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4.3.2 Second-order conditions on a large critical cone 

Recall that for A G A, J[X] has been defined onU x M" by (P3T|) or (jO^ . 

Remark 28. J' is quadratic w.r.t. {v, zq) and alfine w.r.t. A. By lemmas [31 S] and |S1 J7'[A] can be 
extended continuously to V2 x R" for any A G A. We obtain the so-called Hessian of Lagrangian 

J: [A] X V2 X M" — > R (4.30) 

which is jointly continuous w.r.t. A and (w, ^o)- 

The critical cone C2 has been defined by p.34p - p.36p . Let the strict critical L? cone be the 
set 

C| := {{v, zo) G C2 : g'^z = on I„ i = 1, . . . , r} , 
where z = z[v, zq] G 2^2. 

Theorem 29. Let {u,y) be a qualified local solution of (P). Then for any {v,zq) G C2 , there 
exists A G A such that 

J[A](«,zo) >0. (4.31) 

The proof is based on the following density lemma, announced in the introduction and proved 
in the next section: 

Lemma 30. n Cf is dense in Cf for the L"^ x R" norm. 

Proof of theorem Let (u, zq) G Cf . By lemma [501 there exists a sequence [v^ , Zq) G C^nCf , 
fc G N, such that 

(^;^z^) ^ {v,zo). 
By lemma [m there exists a sequence A*^ G A, fc G N, such that 

J[\'']{v\z^)>0. (4.32) 

By theorem [57J A is strongly compact; then there exists A G A such that, up to a subsequence, 

A'^' — > A. 

We conclude by passing to the limit in (|4.32p . thanks to remark □ 

4.3.3 A density result 

In this section we prove lemma [5U1 using lemma [52] b). A result similar to lemma 1501 is stated, 
in the framework of ODEs, as Lemma 5 in [5|, but the proof given there is wrong. Indeed, the 
costates in the optimal control problems of steps a) and c) are actually not of bounded variations 
and thus the solutions are not essentially bounded. It has to be highlighted that in lemma [531 b) 
we get a sequence of essentially bounded v'^. 

Proof of lemma lS^ We define one more cone: 

Cg+ = {(«, zo) eCgnCi : 3S>0 : g'M4v, ^0] = on Zf , z = 1, . . . , r} , 

and we show actually that is dense in Cf . 
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To do so, we consider the following two normed vector spaces: 

X+ {(w,zo) eWxK" : 3^>0 : g'M 4v , zo] ^ on if , i = l,...,r}, 
X2 := {{v, zo) e V2 X M" : gl{y)z[v, zo] = on I„ z = 1, . . . , r} . 

Observe that C^"'' and Cf are defined as the same polyhedral cone by (j3.35|) - (j3.36p . respectively 
in and X2. In view of Lemma 1 in |13| . it is then enough to show that X^ is dense in X2. 
We will need the following lemma, proved in appendix IA.3I 

Lemma 31. Let b, £ ) be such that 

bi = QonX,. (4.33) 

Then there exists bf £ W^^«')^°°(Tf ), S G (0,e), such that 6f ^,''''''"> b, and 

&f=Oonlf. (4.34) 

Going back to the proof of lemma 1501 let {v,zq) G X2 and b := {A2,zoV) We consider a 
sequence (5^ \ and for i = l,...,r, 6f := b^'' £ Vl^('3i)'°°(X?) given by lemma EH Applying 
lemma [23] b) to b^ , we get v'', k e N. We have (w*^, zq) € Ar+ and (u*^, zq) — («, ^o). The proof 
is completed. □ 

4.4 Sufficient conditions 

We still are under the assumptions (A0)-(A4). 

Definition 32. A quadratic form Q over a Hilbert space X is a Legendre form if it is weakly 
lower semi-continuous and if it satisfies the following property: if x'^ x weakly in X and 
Q{x'') — > Q{x), then x'' x strongly in X. 

Theorem 33. Suppose that for any {v, zq) G C2, there exists A G A such that J7'[A] is a Legendre 
form and 

J[X]{v,zo)>0 (1;, zo) 7^ 0. (4.35) 

Then {u,y) is a local solution of (P) satisfying the following quadratic growth condition: there 
exists f3 > and a > such that 

J{u, yo) > J{u, yo) + {\\u - + \yo - yo\f (4.36) 

for any trajectory (m, y) feasible for (P) and such that \\u — t2||oo + l^o ^ yo| ol- 

Remark 34. Let A = (dr;, \E',p) G A. The strengthened Legendre-Clebsch condition 

3a > : Dl^H[p]{t, ut,yt) > al„, for a.a. t G [0, T] (4.37) 

is satisfied iff J'[X] is a Legendre form (it can be porved by combining Theorem 11.6 and 
Theorem 3.3 in [13]). 

Proof of theorem U3[ (i) Let us assume that (|4.35p holds but that (|4.36p does not. Then there 
exists a sequence of feasible trajectories {u^,y^) such that 

1 (^^?/o) ^ > {u,yo), {u'',y^) {u,yo), 

\ Jiu\yl)<J{u,yo)+o{\\u'^-u\\2 + \y^-yo\)'. 
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Let CTfc := - u\\2 + Ij/q ~ Vol and {v'',Zq) := CTj. ^ {u'' - u,y^ - yo) e U x K". There exists 
{v, zq) G V2 X R" such that, up to a subsequence, 

(w'', Zq) ^ (u, Zq) weakly in V2 x K". 

(ii) We claim that (u, zq) G C2. 

Let z'^ := z[ti'^,ZQ] G 3^ and z := z[z;, Zq] G 2'2. We derive from the compact embedding 
Z2 C C ([0,r];R") that, up to a subsequence, 

z'^'^zinC([0,r];R"). (4.39) 
Moreover, it is classical (see e.g. the proof of Lemma 20 in [3]) that 

J(li^ y^) = J{u, yo) + <JkDJ{u, yo){v\z^) + o{crk), (4.40) 

.9(/) = 9{y) + ^kg'iy)z'' + o(afc), (4.41) 

^{yo^yr) = *(yo,yT) + ^Tfci?$(yo,yT)(4':4) + o(CTfc). (4.42) 



It follows that 



DJ{u,yo){v,z„) <0, (4.43) 

g'^{y)z < on I, i = l,...,ri, , , 
g'Mz <0 on I, U% i = ri + 1, . . . ,r. 

D<P{yo,yT)izo,z[v,zo]T) G Tk ($(yo,yT)) , (4.45) 



using (|438)) for_ (|443)) and the fact that {u,y), {u'' ,y^) are feasible for (|444)) and (|445)) . By 
lemmaini given A — (dry, 'I',p) G A, we have 

L»J(u,yo)(w,^o) + / df]tg'{yt) + ^D^{yo,yT){zo,ZT)=0. 

Together with definition [5] and (|4.43p - (|4.45p . it implies that each of the three terms is null, i.e. 
(u, zo) G C2. 

(Hi) Then by (|4.35p there exists A G A such that J' [A] is a Legendre form and 

0<J[~X]{v,zo). (4.46) 

In particular, J[X] is weakly lower semi continuous. Then 

J[X]{v,zo) < liminf J[A](^;^z^) < limsup J[A](^;^ z^). (4.47) 

k 

And we claim that 

limsup J[A](w'=,z^) < 0. (4.48) 
fc 

Indeed, similarly to (|4.40p - (|4.42p . one can show that, A being a multiplier, 

Lfl(u^ y^, A) - Lr{u, yo, A) = ^alDl^y^yLniu, yo, A)(^'^ z^f + o{al). (4.49) 

Since Lfl,(u'', , A) - Lii{u,yo,X) < J{u'',y^) - J{u,yo), we derive from (|4.38p . (|4.49p and 
lemma [50] that 

J[A](«^Zo^)<o(l). (4.50) 
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(iv) We derive from (|07|) and that 

By (|4.35p . {v,zo) = 0, and by definition of a Legendre form, (w'^,Zq) — ;> (w,zo) strongly in 
V2 X M". We get a contradiction with the fact that ||u'^||2 + l^o l = 1 fo^' ^.U k. 

□ 

In view of theorems 1291 and 1331 it appears that under an extra assumption, of the type of strict 
complementarity on the running state constraints, we can state no-gap second-order optimality 
conditions. We denote by ri (A) the relative interior of A (see Definition 2.16 in [J). 

Corollary 35. Let {u,y) he a qualified feasible trajectory for (P). We assume that C| = C2 ana 
that for any A £ ri (A), the strengthened Legendre-Clebsch condition (|4.37p holds. Then [u, y) is a 
local solution of (P) satisfying the quadratic growth condition (|4.36p iff /or any {v, zq) G C2 \{0}, 
there exists A G A such that 

J[A](«,zo) >0. (4.51) 

Proof. Suppose (|4.5ip holds for some A G A; then it holds for some A G ri (A) too and now J[X\ 
is a Legendre form. By theorem 1331 there is locally quadratic growth. 
Conversely, suppose (j4.36p holds for some /3 > and let 

1 _ _ 2 

Jp{u,yo) := J{u,yo) - -/? (||w - w||2 + |yo - Vol) ■ 

Then (u, yo) is a local solution of the following optimization problem: 

min J/3(ti,?/o)i subject to GAu^yo) ^ Ki, i = l,2,3. 

This problem has the same Lagrange multipliers as the reduced problem (write that the respective 
Lagrangian is stationary at (m, j/o))j the same critical cones and its Hessian of Lagrangian is 

M\]{v, zo) - J[A](f , zo) - /? (||«||2 + koD' . 

Theorem [29] applied to this problem gives (j4.5ip . □ 

Remark 36. A sufficient condition (not necessary a priori) to have Cf = C2 is the existence 
of (dry, G A such that 

supp(d^i) =1,, i = l,...,r. 



A Appendix 

A.l Functions of bounded variations 

The main reference here is [T], Section 3.2. Recall that with the definition of i?F ([0, T]; R"*) 
given at the beginning of section for h G BV {[Q,T]-,W*) there exist ha_,hT^ G M"* such 
that (|^ holds. 

Lemma 37. Let h e BV ([0, T]; M"*). Let h\ he defined for all t G [0, T] hy 

h\:^ho_+Ah{[Q,t)), (A.l) 
hl:^ho_+dh{[Q,t]). (A.2) 
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Then they are both in the same equivalence class ofh, /i' is left continuous, h^ is right continuous 
and, for all t ^ [0,T], 



h[ = hT^~dh{[t,T]), 

K[ = hT+-Ah{{t,T]). 



Proof. Theorem 3.28 in [T]. 



(A.3) 
(A.4) 

□ 



The identification between measures and functions of bounded variations that we mention at 
the beginning of section [2^ reUes on the following: 



Lemma 38. The linear map 



(c,m) ^ (h:t^c- ^i{[t,T])^ 



is an isomorphism hetweenW* x ([0, T]; R^*) and BV {[0,T]]W*), whose inverse is 



hr, , d/i 



(A.5) 
(A.6) 

Proof. Theorem 3.30 in [1]. □ 

Let us now prove lemma [TJ 
Proof of lemma{^ By jXSl), a solution in V of (PTU)) is any p € L^{0, T; R"*) such that, for a.e. 

ie [o,r], 



Pt^Dy,^myo,yT)+ f DyH[p]{s,u„y,)ds+ f dry,g'(y,). (A.7) 

Jt J[t,T] 

We define 6: L^{0,T;W'*) L^{0,T;K"*) by 

Q{p)t:^Dy,^^]{yo,yT)+ [ DyH[p]{s,u,,ys)ds+ [ drj^g'iy,) (A.8) 

Jt J[t,T] 

for a.e. t G [0,r], and we show that <d has a unique fixed point. Let C > such that 
Py/lloo,P^,,/||oo<C along [u,y). 



\Q{pi)t-Q{p2)t\ 



{DyH[pi]{s,Us,ys) - DyH[p2]{s,Us,ys))ds 



< C 



C 



\P1{S)~P2{S)\+ / bl(0)-p2W|d0 



T r 



\P1{S)~P2{S)\+ / \pi{s) - P2{s)\de 



ds 



ds 



<C(1 + T) \p,{s)~p2{s)\ds. 

We consider the family of equivalent norms on L^(0,T;R"*) 

||i;||i,K:=||tK^e-^(^-*)iKOIIi (^^ > 0). 



(A.9) 
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mPi)-e{P2)KK <c{i + T) 



T pT 



-K(T-t] 



\pi{s) -P2(s)|dsdi 



Jt 

T 



< 



C{l+T) I e-''^^-'^\pi{s)-p2{s 
C(l+T), 



e'^^'-'Mt 



ds 



K 



-\\Pl -P2\\l.K- 



For K big enough 8 is a contraction on _L^(0, T; M"*) for || ■ ||i,a'; its unique fixed point is the 
unique sohition of (|2.10p . □ 

Another useful result is the following integration by parts formula: 

Lemma 39. Let h,k e BV{[0,T]). Then e L\dk), e L^{dh) and 



Udk 



[O.T] 



k^dh = hT.kT, — ho_kQ_ 



[0,T] 



(A.IO) 



Proof. Let {0 < y < x < T}. Since xn G L^{dh (g) dk), we have by Fubini's Theorem 

(Theorem 7.27 in [T3]) and lemma [571 that /i' € L^(dfc), k"^ G L^(d/i) and we can compute 
dh (g) dk{n) in two different ways: 



dh (g) dk{il) = 



[O.T] J[y,T] 



dhxdky 



I {hr, - h\) dky 

J[Q,T] 



hT+ (fc-z 



/ h\dky, 

J[Q,T] 



dh®dk{VL) = 



dkydhx 



[0,T] J [0.x] 

k^dh.^ - ko_ (liT^ - hQ_) 
[O.T] 



□ 



A. 2 The hidden use of assumption 3 

We use (A3) to prove lemma [55] (and then lemma [221 and then . . . ) through the following: 

Lemma 40. Recall that Mt := DuG\'i'^^^^^{t,ut,yt,u,y) e MI^'^WI xM"*. Then for all t e [0,r], 
MtM^ is invertible and \ (AltMf)'^ \ < 7~^. 

Proof For any x G RI^"°(*)I, 

{MtMjx,x) = \MJx\^ > "f^\x\^. 

Then MtMjx = implies x = and the invertibility follows. 
Let y e and x := [MtMl)'^ y. 

\y\\x\ > {y,x) = (MtM^x.x) = jM.^xp > 7^1^12^ 
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For y 7^ 0, we have x ^ 0; dividing the previous inequaUty by we get 

j'\{MtM^y\\ < \y\. 

The resuh follows. □ 

Before we prove lemma we define the truncation of an integrable function: 

Definition 41. Given any </> e L'^{J) {s £ [l,oo) and J interval), we will call truncation of (p 
the sequence 0*^ G L°°{J) defined for e N and a.a. t G J by 

•t if \<l>t\ < k, 
otherwise. 

Observe that 0'^' — — > </>. 

Proof of lemma [SSl In the sequel we omit zq in the notations. 
(i) Let ti G Vs. We claim that v satisfies 

Mtvt + Nt {z[v]t,v,z[v]) = ht for a.a. t e Ji (A. 11) 

iff there exists w G L''*(J;;M'") such that {v,w) satisfies 

r MtWt =0, / A ^ 

i , / , , , ^T-N -1 /, ,w r 1 r INN foi a.a. t £ Jj . (A. 12) 

\vt = Ml{MtM^) {ht-Ntiz[v]t,v,z[v]))+wt, ^ ' 

Clearly, if {v,w) satisfies (jA.12[) . then v satisfies (|A.11|) . Conversly, suppose that v satisfies 
((XTT|) . With lemmaEOlin mind, we define a G L"(J,;MI^'I) and w G L"(J;;R") by 

a := {MM^y^ Mv, 
w := (l,n - {MM'^y^ v. 

Then 



Mw = 0, 



, „„ on Ji. (A.13) 



We derive from (jA.Up and (IA.13P that 

MtMjat + Nt{z[v\t,v,z[v\) = /it for a.a. t G J;. 
Using again lemma 00] and (jA.lSp , we get (|A.12p . 

(ii) Given {v,h,w) G Vs x L''*(J;; MI^'I) x Jj; M'"), there exists a unique v €Vs such that 
; = u on Jo U • • • U J;_i U J;+i U • • • U J^, 



= Mf (MtM/ ) (/it - Nt{z[i]t,v,z[v])) + wt for a.a. t G J;, 



(A.14) 



Indeed, one can define a mapping from Vs to Vs, using the right-hand side of (jA.14[) . Then it 
can be shown, as in the proof of lemma [U that this mapping is a contraction for a well-suited 
norm, using lemmas [31 HI and 1401 The existence and uniqueness follow. Moreover, a version of 
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the contraction mapping theorem with parameter (see e.g. Theoreme 21-5 in [TU]) shows that v 
depends continuously on {v, h, w). 

(Hi) Let us prove a): let (h,v) G X^(J;;MI^'I) x Vs and let w := 0. Let v £ Vs he the unique 
solution of (|A.14p for {v,h,w). Then w is a solution of (|4.17p by (i). 

(iv) Let us prove b): let (Jitv) £ L''( J;; M'^'I) x Vs as in the statement and let w be given by (i). 
Then v is the unique solution of (|A.14|) for {v, h, w). 

Let e L°°(J/;RI^'I) xU, k £ N, be such that (h^y) and let w'' £ 

L°°{Ji;W"-), fc € N, be the truncation of w. It is obvious from definition WT\ that 



MtWf = for a.a. t £ Ji. 

Let v'^ £ U he the unique solution of (|A.14p for (u*^, /i'^, w*''), k £ N. Then by uniqueness and 
continuity in (ii), 

A V. (A.15) 

And is a solution of (|4.19p hy (i). □ 

A. 3 Approximations in W''^ 

We will prove in this section lemmas [51] and First we give the statement and the proof of a 
general result: 

Lemma 42. Let x £ W'^([0, 1]). For j = 0, . . . ,q — 1, we denote 

and we consider , (3^ £ Mf^ , k £ N, such that {a'j , (3^) — > Then there exists x^ £ 

W^«'°°([0, 1]), fc e N, such that x'' ^^^^ x and, for j = 0, . . . , q - I, 



(A.17) 



Proof Given u £ L'^{[0, 1]), we define x„ £ W^^dO, 1]) by 

Xu{t) ■■= / / ■••/ u{Sq)dSgdSq-l ■ ■ ■ dsi, t £ [0,1]. 

Jo Jo Jo 
Then xl?"' ~ u and, for = 0, . . . , g — 1, 

where Oj £ C([0, 1]) is defined by 

(1 - t]i^'^^^ 
a,(t) :=i^-_i_^,.e[0,l]. 

Indeed, a straightforward induction shows that 

H1) = / / •••/ u{Sq)dSqdSq^l---dSj+l. 

Jo Jo Jo 
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Then integrations by parts give the expression of the aj. Note that the aj {j = 0, . . . ,q — 1) are 
hnearly independent in L^([0,1]). Then 

A: W — > ^^([0,1]) 



/ Ao 



9-1 



is such that A* A is invertible {A* is here the adjoint operator). And 

4-''Hl)=7,, .7=0,...,<7-l ^ A*u={jo,-.-ng-if- (A.18) 
Going back to the lemma, let u := x^'^^ G ^^([0, !])• Observe that 

9-1 - 



W = E7f*' + ^"W' [0,1], 



i=0 



and that = (70, . . . , ^q-i)'^ where 

9-1 

^ (l-j) 



9-1 

7j := - J2 J = 0, . . . ,g - 1. 



Then we consider, for fc g N, the truncation f definition HT|) u*^ e L°°([0, 1]) of m, and 

^'^=/5'-Ea^' J-0,...,g-l, (A.19) 
i=j ^ ■"■ 

u'' u'^' + (7^= - A*u'') , 

9-1 k 

^'W :=^^i'+x„.(i), [0,1]. (A.20) 
1=0 

It is clear that u'' G L°°([0, 1]) (by definition of A); then a;'^ G W^9'°°([0, T]). Since = 7*= 

and in view of (|XT8|) . (f09|l and (|X20|) . ([XTTl) is satisfied. Finally, 7]= — > 7^ (j = 0, . . . , 1); 
then 7*^ — i- A*u and u*"' — > u. 

□ 

We can also prove the following: 

Lemma 43. Let x &W'i-'^{[Q,l]) be such that x'^^^0) = for j = 0, . . . ,q - 1. Then there exists 
^5 g ^9,00 ([0^ 1]) /or (5 > such that x^ x and 

= on [0,(5]. (A.21) 

Proof. We consider u'' G L°°([0,1]), S > 0, such that w'' = on [0,S] and w'^ u := 

Then we define .t* := a;„« (see the previous proof). □ 

Now the proof of lemma [511 is straightforward. 
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Proof of lemmal^ We observe that 5; = on 1; implies that bl =0 at the end points of Ii for 
j = 0, . . . , Qi — I (note that with the definition p.l4p . if one component of li is a singleton, then 
Qi = 1). Then the conclusion follows with lemma H51 applied on each component of 2![ □ 

Finally, we use lemma |42] to prove lemma 1241 

Proof of lemma \^ In the sequel we omit zq in the notations. We define a connection in W^'"" 
between ipi at ti and -02 at t2 as any e W^^'°°([ii, ^2]) such that 

a) We define bi on [0, to] by bi := g^{y)z[v], i = 1, . . . ,r. We need to explain how we define bi 
on {to, T], using bi and connections, to have bi € 14^'''*([0, T]) and bi = bi on each component of 
If n {to,T]. The construction is slightly different whether to G If or not, i.e. whether i £ /f^ or 
not. Note that by definition of eg and of to, If is constant for t in a neighbourhood of to- We 
now distinguish the 2 cases just mentioned: 

1. i G /f^: We denote by [ti,t2] the connected component of If such that to G (ti,t2)- We 
derive from (|4.12p that 6,; = bi on [ti,to]- Then we define bi := 6^ on (to,i2]- 

If If has another component in (^2,1], we denote the first one by [t'i,t2]. Let ijj he a. 
connection in W'^^'°° between bi at t2 to bi at t[. We define bi := tp on {t2,t[), bi :^bi on 
[ti,i2], and so forth on {t'2,T]. 

If If has no more component, we define bi on what is left as a connection in W^'"" between 
h and g[iy)z[v] at T. 

2. i ^ /f^^: If If has a component in [ioiT], we denote the first one by [ti,t2]- Note that 
ti — to > Eo — s > 0. We consider a connection in W'^^'°° between bi at to and bi at ti and 
we continue as in 1. 

If If has no component in [to, I], we do as in 1. 

b) For all k G N, we apply a) to {b^ ,v^) and we get b^ . We just need to explain how we can get, 
for i — \, . . . ,r. 

By construction we have 

on [0,to], bj = g'Mz[v''] giiy)4^], 
on If , 6f = 6,f k = g[ (y) z [v] . 

Then it is enough to show that every connection which appears when we apply a) to {b^ , v^), for 
example -0*^ G W''"°°{\ti,t2\), can be chosen in such a way that 

^ 9[{y)z[v] on [ti,t2]. 

This is possible by lemma □ 
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